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ABSTRACT __ ^ 

Reported are the impacts bf a series bf.wbrkshcps for 
instructional imprDvement conducted by the Faculty Development 
Orgahizaticn of Wittenberg University^ a private^ undergraduate 
institution bf 2300 students. The impacts delineated are the results 
cf an evaluation bf these workshnps. The impacts examined were 
extracted frem the expected outcbmes of various instructional 
improvement programs delineated by Gaff. The impacts selected for 

analysis were j1) the development and use bf new techniques or 

methods of instruction and (2) the develbpment bf favorable attitudes 
toBard teaching and learning by faculty. A survey instrument^ which 
bperaticnalized these two iEapacts^ was administered _tb the population 
of 65 faculty who had participated in one or mere bf the wbrkshbps 
for instructional improvement. A total of 44 completed forms were 
received fbr a response rate of 68 percent. The results tend to 
indicate that the wbrkshbps. did have some impact upon the faculty 

participants^ Most faculty did becbme involved in the process of 

developing hew methods er techniques bf instructicn. More favorable 
attitudes toward teaching and learning were alsb developed. 
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ABSTRACT 

This study reports the impacts of a series of workshops for instruc-- 
tiohal improvement conducted by the Faculty Development Organizatidn of a 
private, undergraduate institution of 2309 students. 

The impacts delineated are the results of an evaluation of these work- 
shops . The impacts examined were extracted from the expected outcomes of 
various instructional improvement programs delineated by Gaff- The impacts 
selected for analysis were (1) the development and use of new techniques or 
methods of instruction and (2) the development of favorable attitudes toward 
teaching and learning by faculty, 

A survey instrument, which bperationalized these two impacts, was 
administered to the population of 65 faculty who had participated in one or 
more of the workshops for instructional improvement. A total of 44 completed 
forms were received for a response rate of 68% , The results tend to indicate 
that the workshops did have some impact upon the faculty participants . Most 
faculty did become involved ia the process of developing new methods or tech-- 
niques of instruction. Moreover, more favorable attitudes toward teaching 
and learning were developed. 



Tha 197Q's Have witnessed an expansion of the concept of faculty 
development. Prior to the 1970' s most colleges and universities assisted 
in the professional development of their faculties through sabbaticals and 
travel funds for attendance at professional meetings. During the 1970's, 
however, faculty development has been expanded to include programs and 
practices designed to improve teaching effectiveness. The extent of this 
expansion is illustrated by the findings of a survey conducted by John Centra 
(1975). The population of accredited degree^-granting institutions of the Uni- 
ted States was surveyed. Centra found that 59% of ihe 1783 respondents in- 
dicated that their institution had Sn orgaxU^ed program or a set of practices 
for faculty development and improving instruction (1976, p. 6). 

Moreover/ expectations for the effectiveness of such programs are 
considerable. Jerry Gaff posits that faculty development is a movement 
which will help to remedy the fundamental deficiencies of doctoral training 
for the preparation of college teaching (1975). Despite the significance of 
this movement, little is known about the impact of such activities upon fac- 
ulty. Some knowledge of the impacts of ihstru.:;tiohal improvement programs 
is important for two principal reasons. The first reason is that the value of 
such activities is an important criterion for the continued support of such 
programs in the current operating budgets of institutions. The second reason 
is embodied in the emergence of a new conceptual paradigm for viewing the 
academic profession. Gaff succinctly states this paradigm as the perspective 
that faculty need more than a knowledge of their academic disciplines in order 
to be effective in and satisfied with their work (1977, p. 511). This perspective 
is the heart of the expanded view of faculty development. However, the validity 



of this new conceptual paradigm is a function of the extent to which faculty 
are deyelbpihg a more whblistic cbhceptibh bf academic work. Thus, some 
knowledge of the impacts that instructiortai improvement programs have upon 
faculty would help to test the validity of this emergent conceptual paradigm; 

The purposes of this paper are twofold: (1) to help to advance know- 
ledge of the impact of instructional improvement programs upon faculty by re- 
porting the results bf the evaluation of such a program > and (2) to suggest an 
approach bf framework far the evaluation of such programs for use by institu- 
tional research officers • 

The results of an evaluation of the teaehlhg improvement cbmpbneht bf 
a four-dimensidnal feculty development program at Wittenberg University, a 
private, undergraduate institution of approximately 2300 students and 140 
full-time faculty, is the foeus of this paper. In addition to teaching improve- 
ment, the other components of the faculty development program at Wittenberg 
are professional enrichment through travel and tuition grants, re-direetion or 
re-training of faculty, and the improvement of counseling of students by faculty 

The specific elements of the teaching irnprovement component assessed 
were nine (9) workshops designed to encourage the use of new methods and 
techniques in the classroom- Examples of some of the topics of these work- 
shops, which were conducted during the 1975-76 and 1976-77 academic years, 
are the writing bf course objectives , the use of groups in the classroom, per- 
sonal style in teaching, and personalized systems of instruction. Thus, these 
workshops placed an emphasis bn both faculty and course development. 

The thrust of this evaluation was not upon the impacts of any one of 
these nine wbrkshops , but rather upon the impacts of these workshops as a 



EVALUATION DESIGN 
The F ^ ariiewark^ 

Possible consequences of instructionai improvement programs for fac- 
ulty, students and organizations have been delineated by Gaff (1975). Gaff 
has extracted these possible consequences or benefits from the expected out- 
comes of various ihstructional improvement programs. From these possible 
consequences two substantive possible benefits for faculty members were 
selected to construct the framework for this evaluation. 

The two possible benefits selected for analysis were: (1) the devel- 
opment and use of new techniques or methods of instruction; and (2) the de- 
velopment of favorable attitudes toward teaching and learning. Impacts are 
defined as the extent to which these two benefits were realized by faculty 
participants in the nine workshops. 

The rationale for utilization of such a framework for evaluation is as 
Idllows: (1) these two possible benefits are attendant to the improvement of 
college teaching; (2) the improvement of teaching is a global objective which 
needed to be expressed in measurable termis; and (3) such an approach to 
evaluation will help to advance the state of knowledge concerning the impact 
of instructional improvement programs by expressing impact in terms of pos- 
sible benefits extracted from the literature. 
The Instrument 

This framework was bperatibnalized through a questibhhaire designed 
for this evaluation. The-^e^e^^^^^^^n^ of new techniques or methods 
of instruction is expressed i^^rms of three dimehsibhs . These three 



dimensions are: (1) the perceived helpfulness of workshops for instructional 
activities; (2) the workshops prompted further reading on instructional innova- 
tions; and (3) the use of instructional innovations in courses as a result of 
attendance at a workshop. Three survey items operatidhalized these dimen- 
sions of the d^2velopment and use of new techniques or methods of instruction. 
Moreover, an overall measure of the impact of the workshops was constructed 
from the summation of responses to these three equal-appearing items. The 
following weights were assigned to these items: helpfulness of wOrkshops-1; 
prompted further reading-2; and innovations tried in courses-3. Thus, impact 
scores can range from 0 to 6 for faculty participants . 

Two Likert-type (6-pdint scale) survey questions provided an indication 
of the degree to which favorable attitudes toward teaching and learning were 
developed. For both of these items, respondents were asked to provide self- 
estimates of the extent to which they agree or disagree that a particular atti- 
tude was developed as a consequence of participation in instructional improve- 
ment workshops . These tv;d sets of attitudes were: (1) a faculty member can 
learn teaching methods and skills; and (2) faculty member should be concerned 
with the methods of teaching as well as the content of an academic discipline. 
• The salience of these two attitudes is that ah expression of them in their neg- 
ative aspects have been identified as impediments to faculty interest in the 
methodology of instruction (Eble, 1972; Francis, 1975; and Gaff, 1975). 

Additional items on the instrument pertain to the number of years the 
respondent has been engaged in teaching, as well as to the division of know- 
ledge (humanities, natural sciences and social sciences) within which the 
respondent teaches . 




Administration of Instrument 

The evaluation Instrument was administered to the entire population 
of faculty who partieipated in one or more of the nine workshops . Thus , a 
total of B5 faculty were surveyed. From this population, a total of 44 com- 
pleted forms were received, for a response rate of 68%. 

FINDINGS 

Profile of Faculty Participants 

Career age, division of knowledge of academic discipline and number 
of workshops attended are the aspects of a profile gathered for faculty parti-- 
cipants who responded to the survey instrument. 

Career age was defined in this study as thp number of years an indi-- 
vidual has been engaged in college teaching. The average career age for 
faculty responding to this item was 14,5 , with a range of two (2) to thirty 
(30) years of college teaching experience. 

In order to help to maintain the anonymity of respondents, individuals 
were asked to indicate the division of knowledge, rather than the specific 
academic discipline within which they teach. Of those participants respiorid- 
ing to this item, 51.2% (N=21) were teaching in the humanities; 26.8% (N=ll) 
were teaching in the natural sciences; and 22% (N=9) were teaching in the 
social sciences . 

A survey item also asked respondents to specify the number of instruc- 
tional improvement workshops they had attended. The number of workshops 
attended ranged from one to seven, with an average of 2 .44 attended. More- 
over, the distribution of attendance at the workshops was bi-modal — 13 
individuals attended one, while 13 attended three; 



New Techniques and Methods 

The development and use of new techniques and methods of instruction 
by faculty participants as an impact of workshops for instructional improve- 
ment was operationalized through three items on the evaluation instrument. 
These three items were: (1) whether or not (yes or no) any of the workshops 
were helpful in faculty instructional activities; (2) whether or not any of the 
workshops prompted further reading on instructional innovations; and (3) 
whether or not anything different in courses was tried as a result of any of 
,the workshops attended. The distribution of responses to these three ques- 
tions are exhibited in Table 1 • 

(Insert Table 1 here) . 

Table 1 reveals that the majority of respondents were impacted by ^ 
the workshops in one or more ways . More specifically, 84. 1% of the res- 
pondents stated that the workshops were helpful to them in their instructional 
activities as a faculty member; SQ% of the respondents did further reading on 
instructional methods; and 84. 1% of the respondents tried a different method 
or technique in their courses , 

The mean composite impact score of 4.36, also displayed in Table 1, 
tends to indicate that thp average faculty participant derived from the work- 
shops at least two of the benefits attendant to the development and use of new 
techniques and methbids of instruction. Moreover, 47.7% of the responderits 
had a composite impact score of six. This suggests that these participants 
found tiie workshops helpful, did further reading on instructional methods > 



arid tried a different method in their courses . Put in different words , maximum 
impact from the workshops in terms of the dev-elopment and use of new tech- 



niques and methods was realized by 47 .7% of the participants. 

Respondents were also asked to describe the different methods at- 
tempted by them in their courses . Analysis of the responses to this un- 
structured question indicates that the use of small groups within classes 
was the method most frequently attempted (N=17). The setting of learnJng 
objectives for the coursi (N=6) and the us^ of self-paced instruction (N=4) 
were also methods frequently cited by respondents, 

The perceived benefit of different instructional methods is a factor 
closely related to the use of such methods in courses . This factor was also 
subjected to analysis . Responses to an item on the evaiuatibn instrument 
con^ .ning the perceived benefits of trying different methods in the course (s) 
indicate that 59.1% of the respondents found the method beneficial to the . 
course. The three most frequently cited methods perceived as bene^cial were 
the setting of course objectives (6); use of small groups within tlie class (5); 
. and small group discussions (o). 

Attitudes Toward Teachmg^ nd Learning 




The other possible benefit selected to evaluate the instructional im- 
provement workshops at Wittenberg University was the development of favor- 
able attitudes toward teaching and learning. The two sets of attitudes se- 



lected for analysis were: (1) faculty can learn teaching methods and skills; 
arid (2) faculty should be concerned with the methods of teaching as well as 
the content of an academic discipline. As previously stated, respondents 




were asked to provide self-estimates of the extent to which they agree or dis--' 
agree (on a 6-point scale) that these attitudes, were developed as a result of 
participation in the workshops- Table 2 displays the distribution of responses 
to these two items . 

(Insert Table 2 here) 

■ ' 

A mean response of 4,89 was obtained to the item concerning tRe learn- 
inq of teaching methods and skills, while a mean of 5 .63 was computed for con 
cern with methods of teaching as well as the content of an academic discipline 
Both of these findings tend to suggest that favorable attitudes toward teaching 
and learning were developed as a result of participation in one or more of the 
workshops of the faculty development program at Wittenberg University. 

Additional Findings. 

Some additional analyses were conducted outside the framework and 
focus of this evaluation. The purpose of these analyses was to help to discern 
if associations between each of the profile characteristics of workshop partici- 
pants and measures of the impacts of the workshops exist. These analyses 
were explcrator/ or heuristic in nature. Moreover, the small number of cases 
in some of the classificatory categories suggest some caution in their inter- 
pretation. Furthermore, the measures of assbciatibri computed are applicable 
only to the population of faculty participants o£ this evaluation. With these 
caveats stated, the results of these additional analyses are iDresehted below . 



Career Age 

Pearson product-moment correlations were used to help to determine 
if an association exists between career age and each of the three measures 
of. impacts used in this evaluation. The resultant correlations tend to indi- 
cate that: (1) almost no relationship ( r= - ,03 ) exists between career age 
and composite impact scores; (2) a small inverse relationship ( r= - .37 ) 
exists between career age and feeling that one can learn teaching methods 
and skills; and (3) there is a small inverse relationship ( r= - .29 ) between 
career age and the feeling that one should be concerned with teaching methods 
as well as the content of their academic disciplines. 

Division^-oi^now ledge of Academic Discipline 

The eta statistic was used to measure the association between division 
of knowledge of academic discipline (humanities., natural sciences and social 
sciences), and the three measures of workshop impacts. Eta is an appropriate 
descriptive measure of association when the independent variable is nominal 
and the dependent variable is at the interval or ratio (Nie and Hull> 1975) level 
' of measurement. The eta statistics obtained are exhibited in Table 3 below . 



(insert Table 3 here) 



# 



These findings tend to suggest tl^at there is a slight association be- 




visibh of knowledge within which a participant teaches and the feeling that 



one should be cdncerned with teaching methods as well as the content of 
their academic discipline feta=, 07) . 

Workshops Attended 

Pearson prbduct^rribmeht correlations were also computed in order to 
help tp discern if there is a relationship between the number of instructional 
improvement workshops attended by faculty and each of the three measures of 
impact. The results of these computations suggest that a slight association 
exists between workshops attended and all three impact me.ctsures. The cor- 
relations obtained were as follows: (1) a correlation of ,30 (N=43) between 
workshops attended and composite impact score; (2) a correlation of ,29 
(N=36) between workshops attended and the attitude toward the learning of 
teaching methods and skills; and (3) a correlation of ,39 (N=36) between 
workshops. attended and the attitude that concern should be for teaching 

_ _______ 'v. 

methods as well as the content of an academiic discipline, 
Biscussioh 

It is' posited that institutional research officers should consider the 
use of this or a similar framework for conducting evaluations of faculty devel^ 
opment programs at their institutions . This suggestion is made for two primary 
reasons.. The' first reason emanates from the global nature of the goals and ob-- 
jectives promulgated by many faculty development programs^ The possible 
benefits for faculty, students and institutions gleaned from the literature by 
Gaff provide a range of measurable factors. Moreover, most of these benefits 

_ _ 0 

are suitable operationalizatiohs of most global program goals and objectives. 
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Thus, most of the benefits delineated by Gaff are suitable, measurable factors 
for the evaluation of faculty development programs. 

The use of the possible benefits identified by Gaff as elements of a 
framework to evaluate faculty development programs would also help to ad- 
vance the state of knowledge concerning the impacts of such programs. These 
benefits represent conceptualizatibhs of the dimensions of the expanded view 
of faculty development. Thus, the evaluation of these benefits would help to 
test the validity of the assumptions undergirding the emergent cbncepuial para- 
digm for viewing the academic profession. This is the second reason for sug- 
gesting the use of this or a similar framework for evaluation. 

Additional Findjln^ 



The additional findings of this evaluation are heuristic. The small num- 
ber of cases and the lack of external validity suggest the heuristic nature of 
these findings pertaining to the association between participant profile char- 
acteristics and impact measures. Further tests of these relationships should 
be made by building these factors into the designs of evaluations of faculty 
development programs conducted by institutional research officers . 
> However, these findings do ha\>e some implications for the faculty de- 

velopment program at Wittenberg. One implication is that future instructional 
improvement workshops at Wittenberg can continue to be focused upon the fac- 
ulty as a whole, rather than upon specific areas of knowledge i Basically, the 



measures of association obtained support such an approach. Put in different 
words, the workshops did not have a strong impact on faculty frbni any particula 



division of knowledge, although faculty of the social sciences were more 
likely to develop new methods and techniques and feel that they can learn 
teaching methods and skills more than faculty from the humanities and 
natural sciences. 

The moderate correlations between the number of workshops attended 
and the three impact measures suggest that faculty who attend more than one 
workshop are more likely to benefit from their experiences than those who at- 
tended only one. Thus, the officials of the faculty development program should 
consider and devise methods to encourage faculty to attend more than one in- 
structidnal improvement workshop. 

The correlations obtained for career age and the three measures of im- 
pact suggest that the deveroiDmeht and use of new methods or techniques is hot 
associated with career age . However, the fewer the number of years of teach- 
ing experience a faculty member has, the more likely it is that favorable atti-. 
tudes toward teaching and learning will be developed. These a^sdciatidris^ 
must be tested further before implications for policy can be drawn from them . 

CONCLUSIONS 

Two rnajor conclusions can be drawn from the findings of this evalua- 
tion. The first conclusion is that the instructional improvement component of 
the faculty development program at Wittenberg had a considerable impact upon 
faculty participants . 

The second conclusion relates to the emergent conceptual paradigm 
for viewing the academic profession. The results of the evaluation suggest 
tfiat, at least on this campus > some faculty are beginning to view academic 



work in more encompassing terms* In different words, the participants of the 
faculty development program at Wittenberg feel that they should be concerned 
with teaching methods as well as the content of their academic disciplines. 
Moreover, they have begun to focus more attention upon the use of Instruc- 
tional methods in their courses. Thus, some faculty at the institution feel 
that their effectiveness as a faculty member goes beyond a knowledge of an 



Table 1 



Distribution of Responses to the Measures 
of the Development and Use of New Techniques 
and Methods by Faculty Participants 



Yes No No Ans , Total 





-^J — 


— %^ 




N 


% 


N 


% 


N 


% 


Helpful 


37 


84. 


1 


7 


15.9 


0 


0 


44 


(100) 


Further reading 


22 


50. 


0 


19 


43.2 


3 


6.8 


44 


(100) 


Tried a different. 




















method 


37 


84. 


1 


6 


13.6 


1 


2.3 


44 


(100) 



.1 



1 

(Continued) 



Distribution Of Composite Impact Scores 



IMPACT SCORES 



0 1 2 3 4 S 6 

N % N % N '% N % N |_ N %_ N %_ 

omposite Impact 5 11. 4 2 4.5 0 0 1 2.3 14 31.8 1 2,3 21 47.7 



lean - 4.36 

tandard Deviation - 2.9,?5 
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Table 2 



Distribution of Responses to the Measures of the 
Development of Favorable Attitudes Toward Teaching and teaming 



RATING SCAtE 



6 5 ^-1 ^,3- 2 1 ^ 

Agree Disagree 

Strongly With With Strongly No Stan. 

Res. Res; Disagree Disagree Answer Mean Dev. 



N % N % N % N % N % N % N %_ 

18 40.9 5 11.4 9 20.5 1 2.3 1. 2;3 2 4.5 2 4.5 4.89 1.43 



for 

19 43.2 9 20;5 4 9.1 8 0 2 4.5 2 4.5 8 18.2 5 .03 1;44 
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Table 3 



Measures of ftssociatiori Between Division of Knd^A; ledge 
of Academic Discipline and Three Measures of Impact 







DIVIS ION OF 


KNOV\^LEDGE 






Humanities 


Natural Sci. 


Social Sci. 


S©mF)bsite Impact 


N 


% 


N 


% 


N 


% 


b 


4 


19.0 


1 


9.1 


0 


3 




e 


9 


2 


18.2 


0 


b 


2 


b 


b 


0 


0 


b 


0 


3 


i 


4.8 


0 


9 


3 


33.3 


4 


7 


33.3 


2 


18.2 


b 


: b 


5 


i 


4.8 


0 


0 


d 


0 


6 


8 


38. 1 


6 


54.5 


6 


66.7 




21 


100.0 


11 


lOO.O 


9 


100.0 


eta = .25712 














-- - MEASURE 




DIVISION OF 


KNOWLEDGE 




Learning Teaching 


Humanities 


Natural Sci. 


SociaLgci. 


Methods 


M 


°/o . 


N 


% 


N 


% 


Strongly Agree (6) 


7 


43.0 


4 


AAA 


5 


62.5 


Agree (5 ) 


1 


6.3 


2 


22.2 


1 


12.5 


Agree with Res . (4) 


6 


37.5 


1 


11.1 


2 


25.0 


Disagree with Res. (3) 


0 


0 


1 


11.1 


0 


0 


Disaaree (2) 


1 


6.3 


• 0 


0 


0 


b 


Strongly Disagrse (1) 


■ 


6^ 


1 


11. 1 




0 


15 


100.0 


9 


. 100.0 


8 


100.0 


eta = .21831 














_ 

MEASURE 




■ DIVISION OF 


KNOWLEDGE 




Concern for Teaching 


Humanities 


Natural Se± . 


Social Sci. 


Methods 


N 


% 


N 


% 




% 


Strongly Agree 


7 


43.8 


5 


66.7 


4 


50.0 


Agree 


5 


31.3 


1 


11.1 


2 


25 .0 


Agree with Res . 


2 


12.5 


1 


11.1 


i 


12.5 


Disagree with Res . 


6 


0 


b 


b 


0 - 


0 


Disagree 


1 


6.3 


9 


e' 


1 


12 ;5 


Strongly Disagree 


J, 


6.3 


1 


11.1 


0 


--- b_ 




16 


100. 0 




190.0 


5 


190.0 



eta = .96830 
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